ChatGPT

Opinion
Health, wellness, doctor, AI

Prompting is Not Clinical Practice: The Limits Of General LLMs in Healthcare

General-purpose LLMs have meaningful value in healthcare - they can support education, documentation and research - as well as lower barriers to knowledge and help improve communication. But acting as a clinical assistant embedded in care delivery requires more - it needs longitudinal EHR grounding, explicit encoding of clinical guidelines, transparent and traceable reasoning and the ability to operate securely at a population scale.

presented by
Health Tech
AI healthcare

In This Round, Humans 1, AI LLMs 0

Anthropic's Claude3-Opus performed better than GPT-4, but both fell short of humans on a test of objective medical knowledge. The study was conducted by a firm developing LLMs specifically for healthcare that claim to be incorporating peer-reviewed sources of information.

Hospitals, Health Tech, Artificial Intelligence, Providers

Research Shows Generative AI In The EHR Can Work Well, But Only With Human Oversight

Mass General Brigham researchers conducted a study to learn more about the efficacy of large language models when used to draft responses to patient messages in the EHR. The results showed that these AI tools can do a good job at reducing physicians’ workloads and improving patient education — but also that these tools have limitations that require human oversight.